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TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS AND METHOD 

5 BACKGROUND OF THE INVENTION 

The present invention relates to an image 
processing apparatus and method thereof, and more 
particularly, to an image processing apparatus and 

10 method thereof for performing conversion processing on 
image data by interpolation operation based on a 
conversion table, and a recording medium where data 
related to the image processing is recorded. 

When image output is performed by a color printer 

15 or the like, color conversion is necessary. For instance, 
when R, G and B image data representing an image 
displayed on a computer monitor is outputted to a color 
ink- jet printer, the R, G and B image data need to be 
converted to C, M, Y and K signals for expressing ink 

20 colors used by the color ink- jet printer. As a color 
conversion method, matrix operation has conventionally 
been employed. 

However, color conversion utilizing matrix 
operation has well-known disadvantages, such as 

25 insufficient color representation. For instance, when 
colors of an image displayed on a monitor are converted 
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to colors of a printing image, color conversion 
characteristics must be precisely simulated. However, 
color conversion using matrix operation is far from 
satisfactory for such requirement. 

In view of this, a lookup table interpolation 
method is available where a color conversion table is 
prepared in advance, and converted image data is 
obtained by interpolation operation based on the 
conversion table. For instance, Display and Imaging (SCI, 
Volume 2, Number 1, 1993, pl7-25) discloses cubic 
interpolation using eight neighboring points, prism 
interpolation using six neighboring points, tetrahedron 
interpolation using four neighboring points and so on. 

When such interpolation using a lookup table (LUT) 
is performed, there is a disadvantage in that the data 
size for a LUT becomes large. For instance, in the 
interpolation processing for outputting C, M, Y and K 
image data, assuming that a conversion table is divided 
into 16 grid points, wherein each color component data 
at each grid point has 8 bits, data having 4 x 17 x 17 x 
17 = 19652 bytes are necessary. 

Furthermore, in the case of a color ink- jet 
printer which realizes high precision image quality, 
seven colors of ink, including three c, m and y low 
density colors in addition to the conventional four 
colors (C, M, Y and K) , are used. Therefore, the LUT 



data size for color conversion is further increased. 



SUMMARY OF THE INVENTION 

The present invention is made in consideration of 
the above situation, and has as its object to provide an 
image processing apparatus and method thereof which can 
keep the memory capacity necessary for storing a 
conversion table for image data conversion small, and a 
recording medium. 

To attain the above object, the present invention 
provides an image processing apparatus for generating 
image data to be output ted by using data conversion, the 
apparatus comprising: first storage means for storing 
compressed conversion table data having compressed grid 
point data of a conversion table arranged by color 
components which are used to construct the image data to 
be outputted; expansion means for expanding the 
compressed conversion table data; and conversion means 
for performing the data conversion by interpolation 
operation based on the expanded conversion table data. 

Furthermore, the present invention provides an 
image processing method for generating image data to be 
outputted by using data conversion, the method 
comprising the steps of: expanding compressed conversion 
table data having compressed grid point data of a 
conversion table arranged by color components which are 



used to construct the image data to be output ted; and 
performing the data conversion by interpolation 
operation based on the expanded conversion table data. 

Furthermore, the present invention provides a data 
5 processing method for processing data used in data 
conversion, the method comprising the steps of: 
inputting conversion table data where combinations of 
plural color component data are arranged by grid points; 
sorting the conversion table data in a color component 

10 unit; and compressing the sorted conversion table data. 
Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 

15 the same or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
20 illustrate embodiments of the invention, and together 

with the description, serve to explain the principles of 
the invention. 

Fig. 1 is a block diagram showing an image 
processing apparatus according to an embodiment of the 
25 present invention; 

Fig. 2A is an example of coordinate setting in a 
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conversion table; 

Figs. 2B and 2C are tables showing input data for 
each grid point in a conversion table; 

Fig. 3 is an explanatory view of data arrangement 
in compressed conversion table data; 

Fig. 4 is a data configuration stored in a LUT 
data buffer; 

Fig. 5 is a flowchart showing a process executed 
by a data restoration unit; 

Fig. 6 is a flowchart showing image processing 
executed by a color conversion processor; and 

Fig. 7 is a flowchart showing a process according 
to a second embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 

will be described in detail in accordance with the 

accompanying drawings . 

[First Embodiment] 

Fig. 1 is a block diagram showing a construction 

of an image processing apparatus according to the 

present embodiment . 

Reference numeral 100 denotes a compressed data 

buffer where compressed LUT data is stored; 101, a data 

restoration unit for expanding (restore) the compressed 

LUT data; 102, a LUT data buffer where the restored LUT 



data is stored; and 103, a color conversion processor 
where C, M, Y and K output image data is generated by 
performing interpolation operation on R, G and B input 
image data based on the LUT data stored in the LUT data 
buffer 102. 

Fig, 6 is a flowchart showing image processing 
executed by the color conversion processor 103 . In step 
Sll, it is determined based on input R, G and B image 
data that to which of the interpolation solids (small 
cubes) shown in Fig. 2A the input image data belongs. In 
accordance with the determination result, eight grid 
points necessary for interpolation, i.e., the grid point 
numbers corresponding to vertices of the interpolation 
solid, are obtained. Then in step S12, a plurality of 
grid point data (C, M, Y and K data) corresponding to 
the obtained grid point numbers are read out of the LUT 
data buffer 102. In step S13 , cubic interpolation for 
each of the C, M, Y and K color components is performed 
with the use of the read plurality of grid point data 
and input image data, and C, M, Y and K output image 
data are generated. 

In the LUT data buffer 102, the combination of C, 
M, Y and K data corresponding to the same grid point are 
arranged by grid point numbers as shown in Fig . 4 . By 
arranging the data as shown in Fig. 4, grid point data 
necessary for interpolation operation can readily be 



read. In the present embodiment, one grid point data 
consists of four bytes. Grid point data for the grid 
point number i is obtained by reading, from the LUT data 
buffer 102, four bytes of data positioned at the 4i-th 
5 from the head address of the LUT data buffer 102. In 
other words, four bytes of C, M, Y and K data 
corresponding to one grid point number can be read in 
single reading operation. 

The data restoration unit 101 and color conversion 

10 processor 103 are realized by, for instance, supplying a 
CPU with a program stored in ROM. Alternatively, image 
processing according to the present embodiment can also 
be realized by a driver which supplies a personal 
computer with a program. In these cases, the LUT data 

15 buffer 102 may be allocated in the RAM or the like 

serving as a CPU work memory. The compressed data buffer 
100 may be stored in a non-volatile memory such as hard 
disk or the like. 

Image data is inputted to the color conversion 

20 processor 103 by an image input device such as an image 
reader, film reader, digital still camera, or digital 
video camera or the like, or a storage device including 
a storage medium such as a .magnetic disk or optical disk 
or the .like, through a predetermined interface. Image 

25 data is outputted by the color conversion processor 103 
to an image output device such as a CRT or LCD monitor, 
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printer, film recorder or the like, or a storage device 
including a storage medium such as a magnetic disk or 
optical disk or the like, through a predetermined 
interface. Moreover, image data may be exchanged with a 
computer device, connected to the aforementioned image 
input /output devices or storage device, through a 
network interface card (NIC) . Such network includes, for 
instance, Ethernet, a network using Fiber Distributed 
Data Interface (FDDI) , a serial bus conforming to the 
IEEE 1394 or Universal Serial Bus (USB) or the like. 

Generation Method of Conversion Table 

Described hereinafter is complementary color 
inversion processing for converting RGB color space of 
input image data to CMYK color space of output image 
data, and a generation method of a conversion table for 
each color component, for performing 100% under color 
removal (UCR) . Assume that each color component data is 
expressed by 8 bits (0 to 255) . 



K 



255 - MAX (R, G, B) 



• . . (1) 



C 



(255 - R) - K 



. . . (2) 



M 



(255 - G) 



K 



• . . (3) 



Y 



(255 - B) - K 



. . . (4) 



where function MAX() outputs a maximum value 



Fig. 2A shows an example of coordinate setting in 
a conversion table, and Fig. 2B shows an example of 
input data for each grid point in a conversion table. 
Output data corresponding to each grid point data on a 
5 one-to-one basis as shown in Fig. 2B is obtained by 

equations (1) to (4) and is shown in Fig. 2C. The LUT 
data, indicative of corresponding relations between the 
grid point numbers and output data {C, M, Y and K) as 

p shown in Fig. 2C, is compressed and stored in the 

[j 10 compressed data buffer 100. 

r|i The LUT data, compressed and stored in the 

^ compressed data buffer 100, is restored to LUT data as 

™ 7 ' shown in Fig. 4 by the data restoration unit 101 as 

Jrf necessary, and stored in the LUT data buffer 102. 

15 Fig. 5 is a flowchart showing a process executed 

-B by the data restoration unit 101. In step SI, the 

compressed LUT data, which has been arranged as shown in 
Fig. 3 for efficient compression, is read out of the 
compressed data buffer 100 and expanded. In step S2 , the 
20 expanded LUT data, which is arranged by color components 
in order of grid point numbers, is sorted as shown in 
Fig. 4. In step S3, the sorted data is stored in the LUT 
data buffer 102. For the LUT data compression method, 
for instance, the widely used Pack-bit method may be 
25 used, where data is compressed at a greater compression 
rate if the same data consecutively continues. 
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Herein, the LUT data stored in the compressed data 
buffer 100 is arranged by color components in order of 
grid point numbers as shown in Fig. 3. Fig. 3 shows that 
125 bytes of each of the C, M, Y and K grid point data 
5 are compressed into i, j , k and m bytes respectively. 
More specifically, i<125, j<125, k<125, and m<125. 

The advantage of arranging LUT data by color 
components in order of grid point numbers as shown in 
m Fig 3 is in that, for instance, with regard to the grid 

10 points 120 to 124 (see Fig. 2C) , since this portion 
J! changes its color from simple yellow ( (C, M, Y, K) = (0, 

!| 0, 255, 0)) to white ( (C, M, Y, K) = (0, 0, 0, 0)), only 

^- the Y data has a value other than 0 while C, M and K 

□ data all have 0. Therefore, when the C, M and K data are 

W 15 arranged by color components in order of grid point 

y3 numbers as shown in Fig. 3, the value 0 consecutively 

continues, thus improving the compression efficiency. 

Generally, a portion where output image data is 
expressed by primary colors (cyan, magenta and yellow) 
20 and secondary colors (red, green and blue) contains no 
black component K. Therefore, at least K data is 
continuously 0. For instance, a portion which changes 
its color from red ( (C, M, Y, K) = (0, 255, 255, 0)) to 
magenta ((C, M, Y, K) = (0, 255, 0, 0)) is expressed by 
25 M and Y data; thus, C and K data continuously have 0. 

Such tendency is not limited to color conversion by the 
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complementary color inversion process or 100% UCR 
process, but occurs in other color conversion methods. 

Therefore, when the LUT data is arranged by color 
components in order of grid point numbers and compressed, 
5 the chance of having continuous 0 data is increased. In 
other words, compared to a case of arranging LUT data by 
grid point numbers as shown in Fig. 4, i.e., CO, MO, Y0, 

K0, CI, Ml, Yl, Kl, C2, , the LUT data arrangement 

shown in Fig. 3 considerably improves the compression 

10 rate. Accordingly, the storage capacity of the 

compressed data buffer 101 where compressed LUT data is 
stored can be efficiently used. 

In the above description, input color space is RGB 
color space and output color space is CMYK color space. 

15 However, the present embodiment is also applicable to 

CMYKcmy color space of a color inkjet printer capable of 
precise printing, which employs C, M, Y and K dark 
colors and c, m and y light colors. For instance, in a 
case where an image is formed in the CMYKcmy color space, 

20 high density of the image is expressed by dark C, M, Y 

and K ink while low density of the image is expressed by 
light c, m and y ink. Therefore, output image data for 
the high density portion mostly has 0 data for c, m and 
y colors, while output image data for the low density 

25 portion mostly has 0 data for C, M, Y and K colors. Thus, 
the LUT data in the CMYKcmy color space includes 
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continuous 0 data more often than that in the CMYK color 
space, and the LUT data compression efficiency is 
further improved. According to the present embodiment, 
the LUT data compression efficiency can be improved not 
only in the case of CMYKcmy color space, but also in a 
case of performing color conversion into a color space 
inclusive of a large number of color components. 

Moreover, in order to simplify the description, 
conversion from RGB color space into CMYK color space is 
performed by complementary color conversion (inversion) 
process and 100% UCR processing in the above description. 
However, any method of color conversion may be employed, 
i.e., the relation between input image data and output 
image data in each grid point may be anything. 

Furthermore, an interpolation method of a 
conversion table for color conversion is not limited to 
cubic interpolation, but may be other interpolation 
methods using other shapes of interpolation medium, such 
as triangular prism interpolation or oblique triangular 
prism interpolation described in pages 347 to 350 in 
"The 1993, 24th Image Engineering Conference Papers", or 
tetrahedron interpolation disclosed in Japanese Patent 
Application Laid-open. No . 2-87192 or the like. 

Moreover, LUT data stored in the compressed data 
buffer 100 is not limited to one table, but a plurality 
of compressed LUT data can be stored by providing the 



compressed data buffer 100 in a database form. Further, 
color space of input/output image data is not limited to 
RGB and CMYK, but may be YIQ, L*a*b*, XYZ color space or 
the like. 

5 If output image data corresponding to input image 

data of each grid point is stored in unit of the grid 
point, the data buffer would include data arrays of 
different color components, which are less likely to 
p have the same data consecutively. Thus, LUT data 

hj 10 compression efficiency considerably declines. 

Jji Furthermore, in a case of storing a plurality of LUT 

SJ data as a LUT database, a problem arises in that a large 

^ s capacity of the storage device is required. In 

;5 comparison, according to the present embodiment, since 

yy 15 output image data corresponding to input image data of 

each grid point is stored in unit of color component, 
the same data consecutively continues. Therefore, when 
performing conversion on 'image data by using LUT 
interpolation operation, LUT data compression efficiency 
20 is improved, and the storage capacity for storing LUT 
data can be saved. 

- [Second Embodiment] 

' Hereinafter, an image processing apparatus 
25 according to the second embodiment of the present 
invention is described. Note that in the second 
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embodiment, with regard to components substantially the 
same as those of the first embodiment, the same 
reference numeral is assigned and detailed description 
thereof will be omitted. 
5 The second embodiment describes a case where the 

image processing shown in the first embodiment is 
applied to a printer driver. 

Printers used lately must be designed while taking 
into consideration of the fact that images are formed on 

10 print media having various characteristics, e.g., 

regular paper, gloss paper, gloss film and so forth. In 
order to realize excellent color reproducibility in such 
print media of various characteristics, it is necessary 
to prepare a LUT having conversion characteristics 

15 corresponding to each of these characteristics of the 
print media. 

An image formed by a printer may include a 
plurality of objects, e.g., photographs, graphics or the 
like, whose preferable color reproduction method is 

20 different. For instance, tonality and color continuity 
are important for photographs, while reproduction of 
bright colors is important for graphics since bright - 
colors are preferentially used in graphics. 

Therefore, in order to output high quality images, 

25 LUTs having conversion characteristics suitable to the 
objects included in input images must be prepared. In 
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other words, in order to obtain high quality output 
images from a printer, an extremely large amount of LUTs 
are necessary for various conditions. Furthermore, a 
plurality of LUTs must be used in single print operation. 
Thus, the LUT data compression method described in 
the first embodiment is used to reduce the memory 
capacity necessary for storing a plurality of LUTs . In 
response to a print command, selected plurality of LUTs 
are expanded according to an image formation condition 
instructed manually by a user, thus enabling quick LUT 
switching. 

Fig. 7 is a flowchart showing an example of the 
process according to the second embodiment. In step S21, 
a print command is inputted. For instance, a print 
command is inputted to a printer driver by giving print 
instruction to an application software by a user. 

In step S22, a print medium data, indicative of 
the print medium on which an image is formed, is 
inputted. The print medium data is data corresponding to 
the type of print medium in default setting, or is 
selected by a user from a dialogue, which is one of the 
user interface of the printer driver displayed when the 
user instructs print operation. If. the printer is 
capable of identifying the type of print medium, the 
data indicative of the identified type of print medium 
is used as the print medium data. 



In step S23, a plurality of compressed LUT data 
corresponding to the inputted print medium data are read 
out of the compressed data buffer 100. The read 
plurality of compressed LUT data correspond to the print 
5 medium data and, for instance, plural types of objects. 
In step S24, each compressed LUT data is subjected to 
the process shown in Fig. 5, and the processed data is 
stored in the LUT data buffer 102. 

In step S25, color conversion processing using a 

10 LUT is performed on the image data which is inputted 

subsequent to the print command. The color conversion 
processor 103 determines the type of object which 
belongs to the input image data by analyzing the input 
image data, and performs color conversion on the input 

15 image data using a LUT corresponding to the 
determination result. 

As described above, according to the second 
embodiment, a plurality of LUTs, corresponding to a 
printing condition inputted along with a print command, 

20 are restored and stored in the LUT data buffer 102. 

Therefore, complicated color reproduction process which 
is suitable to the input image can efficiently be 
performed even when LUTs are stored in a compressed form. 

25 [Third Embodiment] 

Hereinafter, an image processing apparatus 
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according to the third embodiment of the present 
invention is described. Note that in the third 
embodiment, with regard to components substantially the 
same as those of the first embodiment, the same 
reference numeral is assigned and detailed description 
thereof will be omitted. 

The third embodiment describes a LUT changing 
process. For instance, a printer characteristic changes 
according to an environment and a passage of time. Thus, 
in order to always output high quality images by 
performing the image processing descried in the first 
embodiment by a printer driver, it is necessary to 
change LUT data according to the changes in the printer 
characteristics . 

The technique of changing LUT data includes 
calibration. LUT data generation by calibration is a 
technique of forming a plurality of color patches by a 
printer, measuring the obtained color patches, and 
generating LUT data b&sed on the measurement. 

In the third embodiment, the LUT data generated by 
calibration is stored in the compressed data buffer 100 
by performing a reversed process of the process shown in 
Fig. 5. More specifically, LUT data shown Fig. 4, which 
is generated by calibration, is sorted by color 
components in order of grid point numbers and compressed, 
thereby forming compressed LUT data as shown in Fig. 3, 



and then stored in the compressed data buffer 100. 

Note that the third embodiment is applicable not 
only to the LUT data changing process, but also to a LUT 
data addition process. 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., host 
computer, interface, reader, printer) or to an apparatus 
comprising a single device (e.g., copying machine, 
facsimile machine) . 

Further, the object of the present invention can 
also be achieved by providing a storage medium storing 
program codes for performing the aforesaid processes to 
a computer system or apparatus (e.g., a personal 
computer) , reading the program codes, by a CPU or MPU of 
the computer system or apparatus, from the storage 
medium, then executing the program. 

In this case, the program codes read from the 
storage medium realize 'the functions according to the 
embodiments, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage medium, such as a floppy disk, 
a hard disk, an optical disk, a magneto-optical disk, 
CD-ROM, CD-R, a magnetic tape, a non-volatile type 
memory card, and ROM can be used for providing the 
program codes . 



Furthermore, besides aforesaid functions according 
to the above embodiments are realized by executing the 
program codes which are read by a computer, the present 
invention includes a case where an OS (operating system) 
or the like working on the computer performs a part or 
the entire processes in accordance with designations of 
the program codes and realizes functions according to 
the above embodiments . 

Furthermore, the present invention also includes a 
case where, after the program codes read from the 
storage medium are written in a function expansion card 
which is inserted into the computer or in a memory 
provided in a function expansion unit which is connected 
to the computer, CPU or the like contained in the 
function expansion card or unit performs a part or the 
entire process in accordance with designations of the 
program codes and realizes functions of the above 
embodiments . 

The present invention is not limited to the above 
embodiments and various changes and modifications can be 
made within the spirit and scope of the present 
invention. Therefore, to appraise the public of the 
scope of the present invention, the following, claims are 
made . 



WHAT IS CLAIMED IS: 



1. An image processing apparatus for generating 
image data to be outputted by using data conversion, 
said apparatus comprising: 

first storage means for storing compressed 
conversion table data having compressed grid point data 
of a conversion table arranged by color components which 
are used to construct the image data to be outputted; 

expansion means for expanding the compressed 
conversion table data; and 

conversion means for performing said data 
conversion by interpolation operation based on the 
expanded conversion table data. 

2. The apparatus according to claim 1, further 
comprising second storage means for storing the expanded 
conversion table data* 

3. The apparatus according to claim 1, wherein 
said data conversion is a process of converting color 
space of image data. 

4. . The apparatus according to claim 1, wherein 
said data conversion includes complementary color 
conversion and under color removal . 



5. The apparatus according to claim 1, further 
comprising sorting means for sorting the expanded 
conversion table data to generate a combination of 
plural color component data arranged by grid points. 

6. The apparatus according to claim 1, further 
comprising: 

input means for inputting a command indicative of 
print instruction and data indicative of a print medium 
characteristic; and 

control means for expanding a plurality of 
conversion table data for a plurality of conversion 
tables corresponding to the data indicative of the print 
medium characteristic, and performing said data 
conversion by using a conversion table appropriate for a 
characteristic of inputted image data. 

7. An image processing method for generating 
image data to be output ted by using data conversion, 
said method comprising the steps of: 

expanding compressed conversion table data having 
compressed grid point data of a conversion table 
arranged by color components which are used to construct 
the image data to be output ted; and 

performing said data conversion by interpolation 



operation based on the expanded conversion table data. 



8. The method according to claim 7, wherein 
said data conversion is a process of converting color 

5 space of image data. 

9. The method according to claim 7, wherein 
said data conversion includes complementary color 
conversion and under color removal. 

10 

10. The method according to claim 7 , further 
comprising the step of sorting the expanded conversion 
table data to generate a combination of plural color 
component data arranged by grid points. 

15 

11* The method according to claim 7 , further 
comprising the step of: 

inputting a command indicative of print 
instruction and data indicative of a print medium 
20 characteristic ; 

expanding a plurality of conversion table data for 
a plurality of conversion tables corresponding to the 
data indicative of the print medium characteristic; and 

performing said data conversion by using a 
25 conversion table appropriate for a characteristic of 
inputted image data . 
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12. A data processing method for processing data 
used in data conversion, said method comprising the 
steps of: 

5 inputting conversion table data where combinations 

of plural color component data are arranged by grid 
points; 

sorting the conversion table data in a color 
component unit; and 
10 compressing the sorted conversion table data. 

13, A computer program product comprising a 
computer readable medium having computer program code, 
for generating image data to be output ted by using data 

15 conversion, said product comprising: 

expansion procedure code for expanding compressed 
conversion table data having compressed grid point data 
of a conversion table arranged by color components which 
are used to construct the image data to be output ted; 

20 and 

conversion procedure code for performing said data 
conversion by interpolation operation based on the 
expanded conversion table data. 

25 14. A computer program product comprising a 

computer readable medium having computer program code 
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for processing data used in data conversion, said 
product comprising : 

input procedure code for inputting conversion 
table data where combinations of plural color component 
data are arranged by grid points; 

sorting procedure code for sorting the conversion 
table data in a color component unit; and 

compression procedure code for compressing the 
sorted conversion table data. 

15. A computer readable medium recording a 
conversion table which is used in image processing for 
generating image data by data conversion, wherein in 
said conversion table, grid point data is arranged by 
color components which are used to construct the image 
data, then compressed and recorded. 



ABSTRACT OF THE DISCLOSURE 



In a color ink- jet printer using seven colors of 
ink including C, M, Y and K and c, m and y having low 
5 density, the data size of a conversion table used in 

color conversion is large. In view of this, compressed 
conversion table data, having compressed grid point data 
of a conversion table arranged by color components which 
are used to construct image data, is stored in a 
10 compressed data buffer. Then, the compressed conversion 
table data is expanded by a data restoration unit. Then, 
color conversion processor performs color conversion on 
inputted image data by interpolation operation based on 
the expanded conversion table data. 
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